SAH: Shifting-Aware Asymmetric Hashing for Reverse k Maximum Inner Product Search
نویسندگان
چکیده
This paper investigates a new yet challenging problem called Reverse k-Maximum Inner Product Search (RkMIPS). Given query (item) vector, set of item vectors, and user the RkMIPS aims to find vectors whose inner products with vector are one k largest among vectors. We propose first subquadratic-time algorithm, i.e., Shifting-aware Asymmetric Hashing (SAH), tackle problem. To speed up Maximum (MIPS) on we design shifting-invariant asymmetric transformation develop novel sublinear-time Shifting-Aware Locality Sensitive (SA-ALSH) scheme. Furthermore, devise blocking strategy based Cone-Tree effectively prune (in batch). prove that SAH achieves theoretical guarantee for solving RMIPS Experimental results five real-world datasets show runs 4~8x faster than state-of-the-art methods while achieving F1-scores over 90%. The code is available at https://github.com/HuangQiang/SAH.
منابع مشابه
Improved Asymmetric Locality Sensitive Hashing (ALSH) for Maximum Inner Product Search (MIPS)
Recently we showed that the problem of Maximum Inner Product Search (MIPS) is efficient and it admits provably sub-linear hashing algorithms. In [23], we used asymmetric transformations to convert the problem of approximate MIPS into the problem of approximate near neighbor search which can be efficiently solved using L2-LSH. In this paper, we revisit the problem of MIPS and argue that the quan...
متن کاملAsymmetric LSH (ALSH) for Sublinear Time Maximum Inner Product Search (MIPS)
We present the first provably sublinear time hashing algorithm for approximate Maximum Inner Product Search (MIPS). Searching with (un-normalized) inner product as the underlying similarity measure is a known difficult problem and finding hashing schemes for MIPS was considered hard. While the existing Locality Sensitive Hashing (LSH) framework is insufficient for solving MIPS, in this paper we...
متن کاملOn Symmetric and Asymmetric LSHs for Inner Product Search
We consider the problem of designing locality sensitive hashes (LSH) for inner product similarity, and of the power of asymmetric hashes in this context. Shrivastava and Li (2014a) argue that there is no symmetric LSH for the problem and propose an asymmetric LSH based on different mappings for query and database points. However, we show there does exist a simple symmetric LSH that enjoys stron...
متن کاملA Greedy Approach for Budgeted Maximum Inner Product Search
Maximum Inner Product Search (MIPS) is an important task in many machine learning applications such as the prediction phase of a low-rank matrix factorization model for a recommender system. There have been some works on how to perform MIPS in sub-linear time recently. However, most of them do not have the flexibility to control the trade-off between search efficient and search quality. In this...
متن کاملIndexable Probabilistic Matrix Factorization for Maximum Inner Product Search
The Maximum Inner Product Search (MIPS) problem, prevalent in matrix factorization-based recommender systems, scales linearly with the number of objects to score. Recent work has shown that clever post-processing steps can turn the MIPS problem into a nearest neighbour one, allowing sublinear retrieval time either through Locality Sensitive Hashing or various tree structures that partition the ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2023
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v37i4.25550